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ABSTRACT 


Computational  experiments  were  conducted  with  three 
methods  for  solving  the  assignment  problem:  Kuhn's 
Hungarian  method,  a  primal  method  due  to  Balinski  and 
Gomory,  and  a  negative  cycle  method  proposed  by  Klein. 
Kuhn's  method  is  seen  to  be  the  best  of  the  three. 
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AN  EXPERIMENTAL  EVALUATION  OP  SOME  METHODS  OF  SOLVING 
THE  ASSIGNMENT  PROBLEM* 


Michael  Florian**  and  Morton  Klein 


Columbia  University 


.  INTRODUCTION  AND  SUMMARY 


In  [4]  a  general  method  was  proposed  for  finding  minimal 
cost  flows  in  networks ;  for  reasons  which  will  be  made  appar¬ 
ent  in  the  next  section  we  call  it  the  "negative  cycle" 
method.  The  purpose  of  this  paper  is  to  report  on  some  com¬ 
putational  experiments  with  two  variants  of  this  method  as 
applied  to  the  special  minimal  cost  flow  problem  known  as  the 
"assignment  problem",  with  the  Balinski-Gomory  algorithm  for 
the  assignment  problem  [1],  and  with  the  Hungarian  method  for 
the  assignment  problem  proposed  by  Kuhn  [5]. 

The  results  of  our  experiments,  detailed  in  section  4 
are  easily  summarized:  Kuhn's  Hungarian  method  was  the  most 
efficient  (i.e.,  the  fastest)  of  the  methods  tested.  Over 
the  range  of  problem  sizes  with  which  we  worked  (10  x  10  to 
100  x  100  problems)  it  was  approximately  two  to  five  times 


*  This  research  was  supported  by  the  Army,  Navy,  Air  Force 
and  NASA  under  a  contract  administered  by  the  Office  of 
Naval  Research.  Reproduction  in  whole  or  in  part  is  permitted 
for  any  purpose  of  the  United  States  Government. 

**  Currently  at  the  University  of  Montreal. 


Win :: ,  •'  ‘inllliiilferfli'ia:  !!  •  i:i|i!l,i|ll!l!ill;!ifi.ii  MUiS'ViiiiiW-’.;  W 


3 


faster  than  the  next  best  Balinski-Gomory  algorithm.  The 
efficiency  of  variants  of  the  negative  cycle  method  is 
directly  dependent  on  the  efficiency  of  the  sub-routine 
which  is  used  to  locate  such  cycles.  Two  such  sub-routines  - 
the  Floyd-Murchland  method  for  finding  all  shortest  routes  in 
a  network  ([2],  [6])  and  the  Ford-Fulkerson  algorithm  for 
finding  shortest  routes  from  a  particular  vertex  to  all 
others  [3]  were  tested.  Although  the  Ford-Fulkerson  algo¬ 
rithm  was  found  to  be  substantially  the  better  of  the  two,  it 
is  still  not  good  enough  to  make  the  negative  cycle  method 
competitive  with  the  others. 
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2.  THE  ASSIGNMENT  PROBLEM 

In  brief,  the  assignment.  problem  is  to  fill  n  jobs 
by  as  many  men  at  least  total  cost.  Let  a^  >  0  repre¬ 
sent  the  cost  of  assigning  man  i  (i  ■  l,...,n)  to  job 
j  (j  =  n+l,...,2n),  A  an  arbitrary  assignment  of  n  men 
to  n  jobs,  v (A)  the  cost  of  such  an  assignment  (i.e., 

v(A)  =  la..),  and  O  the  set  of  all  (ni)  possible 
A  1  j  o 

assignments.  Then,  an  optimal  assignment  A  ,  by  definition, 

satisfies 


(1) 


JL.e. 


v (A  )  *  v (A)  , 


for  all  A  e  <7 


2  a,,  ^  2  a .  .  , 

A°  ij  a  *3 


for  all  A  e  Cl. 


Evidently  an  assignment  A*  is  optimal  if  and  only  if 
there  is  no  assignment  A  such  that 


(2) 


2  a .  .  -  2  a .  .  <  0 
A  ID  a*  13 


for  all  A  /  A* . 


Now,  suppose  we  associate  the  following  bipartite 
directed  graph  G( A*)  with  assignment  A*.  Vertices  of  the 
first  part  will  correspond  to  men  and  those  of  the  second 
part  to  jobs.  A  directed  edge  connects  job  j  to  man  i 


m  .  J 
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with  associated  cost  -a^ ,  if  a^j  €  A*  >  otherwise,  an 
edge  connects  man  i  to  job  j  with  associated  cost 
a^_.  .  Thus  for  a  small  (say  n  *  3)  problem  with,  say, 

A*  =  (a^  £+3!  i  “  1,2,3]  the  graph  has  the  following  appear¬ 
ance. 


Figure  1 :  The  Graph  G (A* ) 

In  such  a  graph  any  directed  cycle  C  consists  of  an  even 
number  of  distinct  directed  edges  with  alternate  edges 
associated  with  assignment  A*.  A  cycle  is  of  interest  because 
it  can  be  used  as  a  way  of  comparing  the  value  of  A*  with 
that  of  another  assignment,  say  A',  where  A'  is  identical 
to  A*  except  for  those  components  associated  with  the  edges 
of  the  cycle  C.  Within  C  the  components  of  A*  are 
associated  with  the  negative  cost  edges  and  those  of  A' 
with  the  positive  cost  edges.  For  example,  in  Figure  1, 
suppose  C  =  {(1,5),  (5,2),  (2,4),  (4,1)]  (shown  with  solid 
edges),  then  the  components  of  A'  in  C  are  (1,5)  and 


Y 


s 


i 


4 

4 


S'--. 


(2,4)  while  those  of  A*  are  (5,2)  and  (4,1),  The  differ¬ 
ence  in  value  between  A*  and  A*  is  a,.  -  a_~  +  a~,  -  a,,. 

15  52  24  41 

If  this  difference  is  negative,  then  A'  is  a  better  assign¬ 
ment  than  A* . 

More  generally,  given  a  directed  cycle  C  in  G(A*)  and 
an  associated  assignment  A(C),  the  value  of  the  cycle  v(C) 
is  given  by 


(3) 


v(A)  -  v (A*  ) 


A  (C ) 


=  I 
CCA 


ij 


lij 


-  E  a 
A* 


ij 


E  a.  . 
*  30 


=  v(c) 


CCA 


From  (2)  we  know  that  the  assignment  A*  will  be  optimal 
if  and  only  if  there  is  no  assignment  A  such  that  v(C)  <  0. 
In  terms  of  the  graph  G(A*)  this  means  that  A*  is  optimal 
if  and  only  if  G(A*)  contains  no  cycles  whose  value  is 
negative . 
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3.  A  METHOD  FOR  SOLVING  THE  ASSIGNMENT  PROBLEM 

The  preceding  remarks  suggest  the  following  general 
method  for  solving  the  assignment  problem  [4]. 


Preliminary*  Choose  an  arbitrary  assignment. 

Step  1 t  Construct  the  graph  associated  with  the 
assignment. 

Step  2  «  Test  the  graph  for  the  existence  of  a  cycle 
whose  value  is  negative. 

(a)  If  there  are  none  -  stop;  the 
given  assignment  is  optimal. 

(b)  if  a  negative  valued  cycle  exists, 
go  to  Step  3. 


Step  3*  Trace  the  negative  cycle  (i.e.  locate  it) 
and  exchange  the  components  of  the  current 
assignment  with  those  of  the  other  components 
of  the  cycle.  This  yields  a  new  improved 
assignment.  Return  to  Step  1. 


Testing  the  graph  for  the  existence  of  a  negative  cycle 
can  be  done  in  a  variety  of  ways.  However,  all  of  those 
known  to  us  to  be  "reasonably"  efficient,  are  methods  for 
solving  shortest  route  problems  in  graphs  containing  some 
negative  costs  (distances) .  The  two  which  we  have  explored 
are : 

1)  The  Floyd-Murchland  method  for  finding  all  shortest 
routes  in  a  network  [2] ,  ( 6 ]  and 


j 


1 


3 
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2)  The  Ford-Fulkerson  algorithm  [3]  for  finding  a 
shortest  route  from  a  particular  vertex  to  all 
others  in  the  network. 

Both  of  the  above  algorithms  "work",  in  the  sense  of  find¬ 
ing  the  shortest  paths,  if  the  network  does  not  contain  any 
negative  cycles,  and  both  break  down  if  such  cycles  exist. 
This  condition,  when  it  occurs,  leads  to  Step  3  of  the 
proposed  procedure:  tracing  the  cycle  so  that  a  new  improved 
assignment  can  be  determined.  Here  also  we  have  explored 
two  methods : 

1)  the  Ford-Fulkerson  method  used  above,  also  provides 
a  simultaneous  cycle  tracing  routine,  and 

2)  the  use  of  a  "routing"  matrix  which,  when  constructed 
simultaneously  with  the  application  of  the  Floyd- 
Murchland  method,  serves  to  trace  the  vertices 
involved  in  the  negative  cycle. 

The  details  of  the  two  methods  are  given  in  Appendices 
A  and  B. 
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4.  THE  COMPUTATIONAL  EXPERIMENT 

One  hundred  distinct  assignment  problems  (10  each  of 
size  10  x  10,  20  x  20,  100  x  100)  were  generated  using 

a  uniform  distribution  on  the  integers  from  0  to  50. 

Each  of  the  10  x  10  to  50  x  50  problems  were  used  to  test 
all  four  computational  methods  using  an  IBM  360/75  com¬ 
puter.  These  first  runs  demonstrated  that  the  negative 
cycle  method,  with  either  sub-routine,  was  not  competitive 
with  the  other  two,  hence  the  remainder  of  the  experiment 
involved  only  the  Balinski-Gomory  and  Kuhn  algorithms. 

The  results  are  given  in  Table  1,  below. 
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NEGATIVE  CYCLE  METHOD 


PROBLEM 

SIZE 

WITH 

FLOYD - 

MURCHLAND 

WITH 

FORD- 

FULKERSON 

BALINSKI- 

GOMORY 

METHOD 

KUHN'S 

HUNGARIAN 

METRO) 

10  x  10 

.63 

(.28,  1.65) 

.10 

(.05,  .17) 

.04 

(.02,  .05) 

.02 

(.02,  .03) 

20  X  20 

7.7 

(3.4,  12.5) 

.70 

(.35,  1.02) 

.18 

(.12,  .25) 

.10 

(.07,  .13) 

30  X  30 

40 

(29,  50) 

2.2 

(1.9,  2.5) 

.55 

(.43,  .77) 

.26 

(.15,  .50) 

40  X  40 

121 

(67  156) 

4.4 

(2.2,  6.1) 

1.1 

(.9,  1.4) 

.38 

(.17,  .73) 

50  x  50 

205 

(75,  444) 

8.1 

(4.9,  10.4) 

1.9 

(1.5.  2.3) 

.51 

(.35,  .70) 

60  x  60 


70  x  70 


80  x  80 


90  x  90 


100  x  100 


L 

3.9) 

.92 

(.62,  1.36) 

3 

5.1) 

1 

1.5 

(.9,  2.5) 

t 

7.3), 

1.4 

(1.1,  1.8) 

L 

10.0) 

1.8 

(1.4,  3.2) 

4 

-  12.6) 

2.0 

(1.5,  2.6) 

TABLE  Is  AVERAGE  SOLUTION  TIMES  (SECS.)  -  10  TRIALS  EACH; 

(MINIMUM  AND  MAXIMUM  SOLUTION  TIMES  IN  PARENTHESIS) 


- « . .  j"-  *i«wr  i* 
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The  relative  merits  of  the  two  methods  of  detecting 
and  tracing  negative  cycles  may  be  evaluated  more  precisely 
by  looking  at  the  time  per  iteration.  The  reason  for  this 
is  that  each  iteration  (except  the  last  in  each  trial) 
includes  exactly  one  successful  search  for  such  a  cycle; 
thus  the  average  time  per  iteration  is  approximately  equal 
to  the  time  needed  to  locate  and  trace  a  negative  cycle. 

The  results  of  such  an  evaluation  are  shown  in  Table  2 .  As 
can  be  seen  the  Ford-Fulkerson  shortest  route  algorithm  is 
still  the  better  method. 

NEGATIVE  CYCLE  METHOD 


WITH 

FLOYD-MURCHLAND 


.63/3  -  .21 


7.7/9  =  .86 


WITH 

FORD-FULKERSON 


PROBLEM  1 - 

SIZE 


10  x  10 


20  x  20 


30  x  30 


40  x  40  121/20  =  6.0 


50  x  50  209/15  =  14 


TABLE  2  t  AVERAGE  SOLUTION  TIME  ( SECS .  )  PER  AVERAGE 
NUMBER  OF  ITERATIONS  TO  SOLUTION 


.10/2 

=  .05 

.70/5 

=  .  .14 

2.2/8 

=  .28 

4.4/10 

=  .44 

8.1/12 

=  .67 

. . . . 


12 

5 .  CONCLUDING  REMARKS 

A)  Our  evaluation  of  the  performance  of  the  algorithms 
tested  assumes  that  the  computer  programs  employed  for  each 
method  are  equally  "efficient"  in  implementing  the  algo¬ 
rithms.  If  this  is  not  the  case,  we  believe  that  the  large 
difference  between  the  performances  of  the  various  algo¬ 
rithms  suggest  that  the  results  would  hold  for  improved 
programs . 

B)  Although  the  negative  cycle  method  showed  up  as  the 
least  efficient  of  those  tested,  it  still  is  potentially 
improvable.  It  awaits  the  development  of  an  efficient  n ans 
of  detecting  (and  tracing)  the  existence  of  such  cycles  in  a 
directed  graph.  Its  current,  and  perhaps  only,  virtue  is 
its  ease  of  presentation  in  the  classroom  -  independent  of 
linear  programming  theory. 

C)  The  assignment  problem  experiments  suggest  similar 
relative  performances  for  the  generalizations  of  each  of 
these  methods  for  the  transportation  problem.  If  this  is 
true,  the  Ford-Fulkerson  algorithm  (a  generalization  of 
Kuhn's  method)  for  the  transportation  problem  is  also  likely 
to  be  the  best  of  the  group. 
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APPENDIX 


NEGATIVE  CYCLE  ALGORITHM  FOR  THE  ASSIGNMENT  PROBLEM  WITH 
FORD  &  FULKERSON  SHORTEST  ROUTE  METHOD 


n 


1.  Start  computations  with  a  feasible  solution. 

la.  Determine  an  initial  solution  using  Dantzig's  rule.t 
Assign  x  =1  for  a  =  min  [a. .] 

pq  pq  i,j  ^ 

Cross  out  row  p  and  column  q 

x  ,  .  ■  1  for  a  *  min  [a  •  ^ ]  and  so  on 

P's'  13 

until  a  complete  assignment  is  found. 

lb.  Define  the  matrix  A' (x) 

1 


aIj  = 


{■: 


i 

ij 


if  *±j 


if  x. .  =0 
ID 


2.  Use  the  following  heuristic  rulett  to  determine  an  entry 
point  for  step  3. 

For  i  =  l,2,...,n  we  have  an  assignment  such  that 


a 

3 


3 

* 


- 

4 


t  One  of  the  presumed  advantages  of  a  "primal"  method  is 
its'  ability  to  use  "good"  starting  solutions.  Since  we  do 
not  know  of  any  studies  indicating  whether  this  rule  is 
better  than  others,  its  selection  was  arbitrary. 

tt  The  purpose  of  chis  rule  is  to  try  to  get  as  "close1  to 
a  negative  cycle  as  possible.  Since  if  the  initial  point 
is  far  from  such  a  cycle,  it  will  take  longer  to  find  it. 


I 

I-' 
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x. ,  =  1  and  calculate 
ID 


and  (j*  »  r|A*  =  min  A,} 
1  1  i  1 


A*  *  min  A. 

*  J 


Start  at  column  r  and  apply  the  labeling  routine  in 
an  attempt  to  find  the  negative  cycle. 

Let  (M^/dJ  denote  the  label  of  column  j  in  A'(x). 

M.  indicates  the  existence  of  a  chain  from  the  initial 

l 

point  to  M^  and  an  edge  toward  the  column  (vertex) 
j  such  that  the  total  cost  (distance)  is  d^. 

Similarly  a  row  label  is  (J^»d_.). 


W 


w 


£i 


3.  If  is  the  initial  point  -  Label  column  r  (-,o) 

3a.  Mark  each  row  with  label  (Jr»|a^r|) 

3b.  Mark  each  column  j  /  r,  (M^#d^  +  a^), 

wnere  a..  =  (a!. la!,  so  and  x . .  =  1 } 

ID  Di  Di  ID 

3c.  Label  each  row  by 

-fj.  ,  min  [d .  +  la!  .  |  }} 
l  k  j  D  ID  J 

where  represents  the  column  at  which  the  minimum 
is  attained. 

3d.  Label  each  column  +  aij^ 

Continue  steps  b  and  c  until  the  initial  point’s 
label  becomes  negative.  If  a  set  of  row  labels  is 
duplicated  -  stop  -  optinial  scl  ’tion  reached. 

4.  The  negative  cycle  C,  is  identified  by  tracing  back  from 
the  initial  point  according  to  the  succession  of  adjacent 


row  and  column  labels  until  the  Initial  point  Is 
encountered  for  the  second  time  or  some  other  vertex 
is  encountered  twice,  indicating  a  negative  cycle  that 
does  not  involve  the  intial  point. 

5 .  The  negative  cost  cycle  is  represented  by  a  row  vector 
C(X).  Modify  the  flow  X  as  follows 


x 1  = 

ij 


return  to  step  lb. 


xij  ' 


if  (M^Jj)  /L  C 


if  Im.  ,J.  |  €  C  and  x.,  =  1 
i  J  13 

if  |M. ,J. !  €  C  and  x . .  =  0 
1  i  D  ID 
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APPENDIX  B 


NEGATIVE  CYCLE  ALGORITHM  FOR  THE  ASSIGNMENT  PROBLEM  BASED 
ON  THE  FLOYD-MURCHLAND  "ALL  SHORTEST  ROUTES"  METHOD 


1.  Start  computations  with  feasible  solution 
la.  Use  Dantzig's  rule 


Assign  x  **  1 

pq 


for  =  min  (a^J. 


Cross  out  row  p  and  column  q 


x  ,  ,  =  1 

p'q 


for  a  .  ,=  min  [a. . ] 
P  q  i*>  13 


and  so  on  until  a  complete  assignment  is  found, 
o 

lb.  Define  D  a  2n  x  2n  matrix  with  elements 

d|j\  »oo,  i,j  =  l,...,n  and  i,j  *  n+l,...,2n  ? 

=  a .  ,  ,  i  =  l,...,n  and  j  =*  n+l,...,2n  ; 
^  3 


=  -a  ,  x . .  >  0  , 
13  '  3i 

=  00  X  .  .  =  0  , 

3i 


i  =  n+1, . . . ,2n;  j=l, . 
i  =  n+l,...,2n?  j=l,. 


Note:  In  the  computations,  the  matrix  X  =  {x^}  is  not 
required. 

2.  Test  for  the  existence  of  a  negative  cycle  by  applying 
the  Floyd-Murchland  algorithm  to  the  D°  matrix. 

2a.  For  k  =  l,...,n  compute 

d!^  =  min  (d..  +  d.  . »  df*“^]  for  i,j  /  k, 
lj  ik  xj  i] 


2b.  Record  "ROUTE"  on  routing  matrix  U  =  [u^  J 


*h 


1£  aik +  \i  * 


/  otherwise 


uij  =  luJ2n  x  2n* 

If  a  substitution  is  made  in  [d^  ]  such  that  the 

shortest  route  from  i  -  j  is  through  vertex  k, 

the  index  k  serves  to  trace  the  path  of  the  short- 

est  distance  from  i  -14  j . 

2c.  Test  for  all  k  the  value  of  d, , 

ix 


If  d. .  2  0 

XX 

If  d.  .  1  0 
li 


If  d. .  <  0 

li 


for  all  i  and  k  <  n,  go  to  2a. 

for  all  i  and  k  ■  n,  stop, 
optimal  solution  reached. 

for  some  i  record  r  *  {i|di:i  <  0} 
and  go  to  step  3. 


3.  Cycle  Tracing 

Let  C  be  a  row  vector  that  contains  the  cycle  elements. 
The  maximum  size  of  this  vector  is  (2n  +  1) . 

3a.  Initiate  search  with  c^  =  r;  c2  =  urr;  c^  *  r 

Let  k  denote  the  number  of  elements  in  C;  (k  =  3 
at  this  stage) . 

3b.  For  i  =  1 , . . . , 2n 

Let  h  -  v  •  <w 

U^1^2  =  ®  return  to  start  of  3b. 

If  u,  ,  ^  0  then  modify  c.  as  follows 

1112  1 


. r  -  rnrii  irirvifiii  1 1  iiniriiirtrn »  iiitmifirnir  riiiflTTr  roitr Tin i iinir nih nif ii<fflinTiniiTBiMriiiffiwr«WWMrMWiiMWiiWffPrr^^ 


,  wmanprir  «WWW'f,5 


ci+i  '  ui1iJ  • 


'i  -ci 


C  1  =  c 

j+2  Cj+1 


for  j  ■  1, . . .  ,k 


k'  *  k  +1; 

then  go  back  to  start  of  3b. 

When  this  procedure  terminates,  C  =  (c^)  contains  the 
cycle  elements  and  k  equals  the  number  of  entries  in 
the  cycle. 

The  number  of  vertices  involved  in  the  cycle  is  k  -  1. 

4.  Modify  solution 

4a .  For  i  *  i , . . . ,k 

Let  i^  s  i  ;  i2  *  i  +  1 

4b.  If  c.  >  c.  go  to  4c,  otherwise  go  to  4d. 

*1  2 

4c.  If  d.  <0  put  d.  d.  =oo, 

V2  X1  l2 

otherwise  d.  .  =  -  d.  d.  and  return  to  4a. 

11  2  11  x2 

4d.  If  d.  .  <0  put  d.  .  =oo, 

2  1  *2  1 

otherwise  d.  .  “  -  d,  .  and  return  to  4a. 

Vl  Vl 

When  this  procedure  terminates  for  i  =  l,...,k 
return  to  step  2 . 
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Computational  experiments  were  conducted  with  three 
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